Don't Judge Software by Its (Code) Coverage
نویسندگان
چکیده
This position paper argues that using code coverage metrics to evaluate the completeness of test cases as prescribed by e.g. ISO26262, is insufficient in a safety context. On the other hand it is impossible to execute test cases that achieve 100% completeness with respect to all possible input data combinations testing all requirements. We propose that existing requirements on code coverage shall be extended with requirements on 100% coverage of the safety requirements. As an example, the paper illustrates how this can be done for the AUTOSAR end-to-end protection library.
منابع مشابه
Don't Repeat Yourself: Automatically Synthesizing Client-side Validation Code for Web Applications
In this paper, we outline the groundwork for a new software development approach where developers author the server-side application logic and rely on tools to automatically synthesize the corresponding client-side application logic. Our approach uses program analysis techniques to extract a logical specification from the server and synthesizes client code from that specification. Our implement...
متن کاملState Coverage: Software validation metrics beyond Code Coverage - Extended Version
Currently, testing is still the most important approach to reduce the amount of software defects. Software quality metrics help to prioritize where additional testing is necessary by measuring the quality of the code. Most approaches to estimate whether some unit of code is sufficiently tested are based on code coverage, which measures what code fragments are exercised by the test suite. Unfort...
متن کاملMinimal Test Case Generation for Effective Program Test using Control Structure Methods and Test Effectiveness Ratio
Software testing is the critical activity in any industrial–strength software development process. As the software grows in size, its complexity increases and testing becomes more difficult. Hence generating test cases manually produces more errors and affects overall system quality. In this paper, we have proposed a tool for automatic generation of test cases using the control structure method...
متن کاملState Coverage: Software Validation Metrics beyond Code Coverage
Currently, testing is still the most important approach to reduce the amount of software defects. Software quality metrics help to prioritize where additional testing is necessary by measuring the quality of the code. Most approaches to estimate whether some unit of code is sufficiently tested are based on code coverage, which measures what code fragments are exercised by the test suite. Unfort...
متن کاملApplicability of modified condition/decision coverage to software testing
Modified condition/decision coverage is a structural coverage criterion requiring that each condition within a decision is shown by execution to independently and correctly affect the outcome of the decision. This criterion was developed to help meet the need for extensive testing of complex Boolean expressions in safety-critical applications. The paper describes the modified condition/decision...
متن کامل